UNIQUENESS AND DISJOINTNESS OF KLYACHKO MODELS 

f-^ . OMER OFFEN AND EITAN SAYAG 

O 

O 

*ivj ' Abstract. Wc show the uniqueness and disjointness of Klyachko models for 

GLn over a non-archimedean local field. This completes, in particular, the 

^ 1 study of Klyachko models on the unitary dual. Our local results imply a 

O ' global rigidity property for the discrete automorphic spectrum. 

a^ 

1. Introduction 

f-H ' In this work wc show that over a local non-archimedean field, the mixed (symplectic- 

q/ , Whittaker) models introduced by Klyachko in |Kly84| are disjoint and that mul- 

tiplicity one is satisfied. In [OSj we showed, over a p-adic field (a finite extension 
of Qp), the existence of Klyachko models for unitary representations. The up shot 
•^ ' is then that for every irreducible, unitary representation of GLn over a p-adic field 

there is a unique Klyachko model where it appears and it appears there with mul- 
tipHcity one. 

To formulate the main result more precisely wc introduce some notation. Let 
^ ' F be a non-archimedean local field. For a positive integer r, denote by Ur the 

^^ , subgroup of upper triangular unipotent matrices in GLr and let 

00 . 
00 ■ Sp2k = {g e GL2k ■ gJ2kg = J2k} 

where 

Wk 



^ 



(N 



'hk — 1 n 

-Wk 



f~^ \ and Wk e GLk{F) is the matrix with {i,jY'^ entry equal to 6i^n+i-j- Whenever 

n = r + 2k we consider the subgroup ffr,2fc of GL„ defined by 

^ ■ Hr,2k = { ( j^ ] ■ U e Ur, X e A/rx2fc, h G Sp2k}- 

^ Let i/i be a non trivial character of F. For u ~ (uij) G Ur{F) we set 

(1) ^r(w) = ■0(wi,2 H hMr-l,r)- 

Let ipr,2k be the character of Hr.2k{F) defined by 

(2) A,2k (q ^ j ^tlJr{u). 
When n = r + 2k the space 

Mr^2k^lnd%^^;l^lpr) 

is referred to as a Klyachko model and wc say that a representation it of GLn{F) 
admits the Klyachko model M.r.2k if HomGi^(j?)(7r,7Wr.2fc) 7^ 0. Here Ind denotes 
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2 OMER OFFEN AND EITAN SAYAG 

the functor of non-compact smooth induction and representations of GLn{F) are 
always assumed to be smooth. The main resuh of this paper is the following. 

Theorem 1. Let F be a non-archimedean local field and let tt be an irreducible 
representation of GLn{F) then 

[f] 
(3) dmic(HomGL„(F)(7r, ® Mn-2k,2k)) < 1- 

k=0 



Denote by 



dimc(HomGi (f^)(7r, © Mn-2k.2k)) 

k=0 



the multiplicity of w in the direct sum of the Klyachko models. When i^ is a 
finite field, it is proved in |IS91| that m^r = 1 for every irreducible representation 
TT of GLn{F). When i^ is a non-archimedean local field it is shown in |HR90j that 
there exists an irreducible representation n of GL^{F) so that m-Tr = 0. Thus, we 
cannot expect in general for the inequality ^ to be an equality. However, in [OS] 
we showed that if _F is a p-adic field then m^ > 1 for every irreducible, unitary 
representation tt of GLn{F). We therefore have the following. 

Corollary 1. Let F be a p-adic field and let n be an irreducible, unitary represen- 
tation of GLn{F) then 

[f] 
dimc(HomGi (j^)(7r, © A^„-2fe.2fc)) = 1- 

fc=0 

By Frobenius receiprocity |BZ76[ §2.28] for a representation tt of GLn{F) we 
have 

(4) }ioTaGL^(F){T^,Mr,2k) = Hom^^^^^ (j?) (tt, ?/'r)- 

It follows that for an irreducible, unitary representation tt of GLn{F) there is a 
unique integer < K(7r) < [§] such that 

Homfl'^_3^^^j_2^j^j(i^)(7r,l/'„-2K(7r),2K(7r)) ^ 0, 

i.e. such that tt is {Hn_2K{Tr).2K{Tr},''Pn-2K{ir),2n{Tr))- distinguished and that the space 
of such functionals is one dimensional. 

Remark 1 . In |OS07[ Theorem 1] , when F is a p-adic field and n is even, we exhib- 
ited a family of irreducible, unitary representations of GLn{F) that are Spn{F)- 
distinguished. We promised in [OS07| that in [0S| we will show that this fam- 
ily exhausts all irreducible, unitary representations that are S'pri(F)-distinguished. 
Eventually, we postponed the delivery of this statement to the current paper. It is 
immediate from Corollary [TJ 

In |0S| we also studied globally over a number field, the mixed (symplectic- 
Whittaker) periods on the discrete automorphic spectrum of GL„. Let i^ be a 
number field and let V' be a non-trivial character of F\Ap. We use ([T]) to view ipr 
as a character of UriAp) and ^ to view ipr,2k as a character of Hr^2k{^F)- For an 
automorphic form (j) hi the discrete spectrum automorphic spectrum of GLn{Ap) 
and a decomposition n = r + 2fc we consider the mixed period integral 

(5) Pr,2kW= f 4>{h)i,r,2k{h) dh. 
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We say that an irreducible, discrete spectrum automorphic representation n of 
GLn^Ap) is Hr. 2k- distinguished if Pr,2k is not identically zero on the space of tt. In 
|0S| we provided an exphcit integer < k{tt) < [|] such that tt is (i?„_2K(ir),2K(7r), V'n-2K(7r),2K(7r) 
distinguished. Furthermore, we showed that this period integral is factorizable. 
Corollary [1] (particularly, the disjointncss of Klyachko models) then shows that 
there is a unique such integer. Furthermore, it implies the following rigidity prop- 
erty of the discrete automorphic spectrum of GLn ■ 

Theorem 2. Let F be a number field and let n = ^^tTu he an irreducible, discrete 
spectrum automorphic representation o/G(Ai?). Then the following are equivalent: 

(1) TT is {Hr^2kTipr) — distinguished; 

(2) TTy is (Hr.2k,'>Pr) — distinguished for all places v of F; 

(3) TTyg is (Hr,2kii^r)-'distinguished for some finite place vq of F . 

The rest of this work is organized as follows. After setting up the notation in 
311 in iJSl-glwe reduce Theorem [T] to a statement about invariant distributions on 
orbits. This statement is made more explicit in 3S]and is then proved by induction 



2. Notation 

Let F be a non-archimedean local field and for any positive integer r let G,- = 
GLr{F). We also set Go = {1}. Throughout, wc fix a positive integer n and let G = 
G„. For a partition (ni, . . . , nt) of n we denote by P(ni,....nt) the standard parabolic 
subgroup of G of type (ni, ...,714). It consists of matrices in upper triangular block 
form. If P = P(7ii,....nt) 'W6 denote by P the parabolic opposite to P. It consists of 
matrices in lower triangular form. When we say that P = MU is the standard Levi 
decomposition of P we mean that U is its unipotent radical, and M = P C\ P = 
{diag(5i, . . . ,gt) : gi G Gm}- We then denote by U the unipotent radical of P. We 
denote by a^'"' the r-tuple (a, . . . , a), thus for example -P(i)" is the subgroup of upper 
triangular matrices in G. For any standard Levi subgroup M of G denote by Wm 
the Wcyl group of M and let W = Wg ■ If M' is another standard Levi subgroup 
then any double coset in Wm\W/Wm' has a unique element of minimal length 
which wc refer to as a left Wm and right Wm' reduced Wcyl clement. We denote 
by mWm' the set of all left Wm and right Wm' reduced Weyl elements. For integers 
a and h we set [a, 6] = {a; G Z : a < x < 6}. For any subset A C [1, n] we denote by 
SA the permutation group in the elements of A. It will be convenient to identify 
W with ^[l, n]. If P = MU and P' = M'U' are standard parabolic subgroups of G 
with their standard Levi decompositions, the Bruhat decomposition of G gives the 
disjoint union 

(6) G= U PwP'. 



For any matrix X let *X denote the transpose matrix. For a skew-symmetric 
matrix T = — *X G G2k let 

Sp{l) = {g e G2k ■■ 'gig = 1} 

and let 

T I Wk 

•J2k — n 
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where Wk G Gk is the matrix with ij^^ entry 6i.n+i-j- Denote by Ur the subgroup 
of upper triangular unipotcnt matrices and by Ur the subgroup of lower triangular 
unipotent matrices in G,.. For non-negative integers r and k let 



and let 



Hr,2k ={[ Q ^ ] ■.ueUr,Xe M,x2fc(F), h G Sp{J2k)} 



Hr^k = {[x \ )-U^Ur,Xe M2kxr{F), h £ 5p( Jsfc)}. 



Note that Hr^2k is the image of Hr,2k under transpose. For g G G let 

The restriction to Hr,2k of the involution t : G ^ G defines a group isomorphism 
bomHr,2k toHr:2k- Lct 71 = r+2k = r'+2k' and let W^'"' = HY' = Hr^2k><Hr',2k'- 
Thus 

We denote by e^^r.r' the identity element of W''' . It will also be useful to consider 
the map ^ : Ti.'''''' -^ W' ^"^ defined by 

ahi,hl) = {h2,hl). 

The group W''' acts on G by 

h-g = hig'h2, h={huhl) EH'^^'-^geG. 

We observe that 

(7) \h-g)=ah)-'g,heH'''^\geG. 

When r = r' the map ^ is an involution of W^'". The formula ([7]) allows us then to 
define the semi direct product 

with multiplication rule 

{h,e){h',e') = (/ie.(/^'),«') where e.W = {'', '" \ 

Here /i, /i' £ W''', e, e' e {±1}. The group H''-'' acts on G by 

(/i, e) • 5 = /i • T,(5) where T,{g) = J f ' " \ 

In order to unify notation, when r ^ r' we shall set H^'^ ~ W''' x {!}. 

For a non-trivial character ip oi F we define as in 21 the generic character ipr 
of C/r by ll]) and the character ■(/'r,2fc of Hr.2k by ([2]). Let 9^'^ be the character of 
H^'"^ defined by 

6''"''' [hi, hi) ^ 1pr.2kihl)lpr',2k'{h2)- 

We also extend 9'^'^ to the character 0''''" of H^'^ defined by 

^'■''■'(/i,e) = e6i''^'^'(/i). 
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3. Reduction to Invariant Distributions 



ctr.r 



Let n = r + 2k = r' + 2k' be 2 decompositions of n. Let H = TC''^ and 6 
The action of H on G defines an action on C^{G) and on the space ©(G) = C^{G)* 
of distributions on G by 

{h ■ 4>){9) = 0(/i-' ■ g) and (/i • D){4,) = i?(/j-i • 0) 

fovheii, g € G, (/} £ C^{G) and Z? G X)(G). In this section we show that Theorem 
[T] reduces to the foUowing. 

Proposition 1. If D e I)(G) is such that h-D = 0{h)D for allheH then £) = 0, 
i.e. 

(8) Hom^(Cr(G),0~) = O. 

3.1. Proposition [l] implies Theorem [H Let it be an irreducible representation 
of G. Set H — Hr^2k, H' — Hr'.2k', V' = V'r,2fc (forgivc the abuse of notation) and 
-0' = i'r' ,2k' ■ Denote by H (resp. H') the image of H (resp. H') under r. Let 
£ e IIomi:/(7r,-0) and i' G HomH/(7r, ?/;'). The representation Tr'^ig) = T^{g'^) realizes 
the contragradiant representation tt on the space T4- of tt jGK75| (see also |BZ76[ 
Theorem 7.3]). Note that £' G Hom-yT(7r'^ , {ip'y) defines a functional £' on the space 
V# of TT and that i' G IIom-gT(7r, (^')^)- Note further that ioTT{4>) is a smooth vector 
in V#. Define the distribution D on G by 

(9) i?(0)=£'(£o^(<^)), </,GGr(G). 

For h e H and /i' G iJ' we have 7r((/i^\ */i') •(/)) = TT{h)oTT{(f>)oTr{*h') and therefore 
((/i, (/i')^) • D){(f>) = f{^ o 7r(/i) o 7r(0) o 7r(*/i'))- 

By our assumption on (. and (,' we have, £ o n{h) = ijj{h)i and £' o Ti{{h'Y) = 
ijj'{h')i' , h € H, h' E H' . Also note that for any v £ Vj^ viewed as a smooth 
functional on tt the composition v o T:{g) is again a smooth functional on tt and in 
fact 

(f) o ■n{g)){v) = 'D(7r(5r)w) = {%{g^^)v){v) 
i.e., 

wo7r(g) = 7r(5"^)w. 
Applying this to {i = £ o 7r((^) and g = */i' we get that 

{{h, (hr) ■ D){4>) = iih) i'{{t o ^(0)) o nCh')) 

= ^{h) I'mnrKe o Trim = oi^ (hr) d{<p). 

We see that D is (7i, 6')-equivariant. If r 7^ r' it follows from Proposition [1] that 
D = 0. If we assume further that I is non-zero then the vectors £oTr{(j>), cj) G C^{G) 
span Vj^. We conclude that £' must vanish identically on T4 and hence also i' = 0. 
This shows that 

(10) dimc(IIomH,,2j^(7r,'0r,2fc))dimc(Hom//^,^^,(7r,'(/)r',2fc')) = whenever r ^ r'. 

Assume now that r = r' . Recall that e-u is the unit element of TC. Note that 
(ew,-l) • = *0 where *0(g) = 0(*5), G C^{G), g e G. Note further that for 
every h eH we have 

ih,l)ien,-l) = {eH,-mih)A) 
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and that 0i^{h)) = e{h). Since D e RomniC^{G),0), it also follows that 

Di = D- {en, -I) ■ D e Hom„(Cr (G), 0). 

Furthermore, since 9{e-H,—^) = —1 and (e->^,— 1) • Di ~ —Di we conclude that 
Di G Hom^ (C^(G), 6*). Proposition [1] now implies that 

(11) D = ien,-l)-D. 

Let B : C^{G) x C^iG) ^ C be the bihnear form defined by 

(12) B(0i,(/.2)=i?((^l*02) 

where 

{(j)i *(j)2){g) = / (t)iix)(j)2ix~^ g) dx. 

JG 

Note that 

7r(</«i * 02) == 7r((/)i) o 7r((/)2) and *(</>i * ^2) == V2 * Vi, 0i, 02 G G;?°(G). 
Thus, (fTTj) implies that 

B(0i, (/)2) = B((ew, -1) • 02, (ew, -1) • 0i). 
This implies that Rb = (e^^, —1) • Lb where 

Lb = {0 e Gr (G) : B(0, •) = 0} and i?B = {0 G G^ (G) : B(-, 0) = 0} 
are respectively the left and right kernels of B. In other words 

(13) i?s = {V:0eii3}- 
For a functional A on V^- let 

il(A,7r) = {0gG,°°(G) : Ao7r(0) =0}. 

Note that 

i?(0i,02) = (^~'o^(02^))(€o7r(0i)) 
where 

0^(ff)-0(5"') 
and therefore 

Lb = i?(^, tt) and i?B = {0^ : G J?(£', ^)}. 
By our definitions we have 

il(f ,^) = il(£',^^) = {(V)^ : G ^(^',7r)} 

and therefore 

i?B = {V:0GJ?(£',7r)}. 
It now follows from (|13p that 

j?(^,7r) =il(f,7r). 

Since tt is irreducible we get that ker£ = ker^' and therefore that € and i' are 
proportional. We therefore proved that 

(14) dimc(Homa^,,(7r,7/.^,2fc)) < 1 for all < fc < [-]. 
Theorem [1] is now a straightforward consequence of ([H , (fTOj) and (fT4|l . 
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4. Reduction to 7Y-orbits 

We keep the notation introduced in Sj3l For every g G G wc denote by Hg the 
stabiUzer of 5 in H and by Tig the stabihzer of g in ?i. The purpose of this section 
is to reduce Proposition [T] to the foUowing. 

Proposition 2. For every g (z G the character 9 is non-trivial on Tig. 

Remark 2. The objects involved and the statement of Proposition [2] makes sense 
over any field F and in fact, our proof is valid in this generality. In particular, 
using Mackey theory, it can provide an alternative proof of the uniqueness and 
disjointness of Klyachko models over a finite field. 

4.1. Proposition [2] implies Proposition [TJ Assume now that Proposition [2] 
holds. We deduce that Proposition[T]also holds. Let 1^ denote the trivial character 

of Tig. Note that h ■ g ^^ Hg h^^ is a homeomorphism of H-spaces TL ■ g ~ TigXH 
that induces an 7i-isomorphism 

(15) C-(?^.g)2.indg^(l^J 

where ind denotes smooth induction with compact support. Therefore, by Frobe- 
nius reciprocity |BZ76[ §2.29] 

(16) Hom^(C;?°(H-g),6i) = Hom.^^(5^^,6l|.^^) 

where 5^: is the modulus function of Tig. Since the image of lies in the unit circle 
(in fact, the image of 9 lies in the group of p-powered roots of unity where p is the 
residual characteristic of F) and since fc is positive, we get that whenever 9,jj is 
non-trivial we also have 

(17) e^n.^^n,- 

It follows from Proposition [2] that (fTT]) holds for every g ^ G and therefore by ^5]) 
that 

(18) Hom^(C,°°(H • g), 9) - 0, .g G G. 

Proposition [T] follows from (fT8|) using the theory of Gelfand-Kazhdan |GK75| . In- 
deed, we apply [BZ76[ Theorem 6.9] to the following setting. We view C^{G) as a 
module over itself by convolution. By |BZ76[ Proposition 1.14] it uniquely defines 
a sheaf T over the /-space G. We let H act on G^{G) by 

h-g(t)^ 9{h)h ■ (j). 

This defines an action of H on the sheaf T. The space of TY-invariant distributions 
on T is then precisely IIom.^(C^(G),0). The action of H on G is constructible 
by |BZ76| §6.15, Theorem A]. The second assumption of |BZ76| Theorem 6.9] is 
precisely (fT8|) . It follows that there are no 7Y-invariant distributions on the sheaf 
J", i.e. that © holds. 

5. The property of H-orbits made explicit 

In order to prove Proposition [2] it will be convenient to reformulate it, by de- 
scribing more explicitly the property of the 7Y-orbits that we wish to prove. We 
begin with this reformulation. 
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5.1. The property V{g,r,r'). For g 6 G let 'P{g,r,r') = "Pnls, ?',?'') be the fol- 
lowing property: either 

(19) there exists y e i?r,2fc such that g^^yg G Hr',2k' and 9^-^ {y,g^^yg) ¥" 1 
or r =: r' and 

(20) there exists y e Hr,2k such that g^^y *(? G iifr.2fe and 6^'^{y,g^^y *g) = 1. 
Lemma 1. i^or every g G G, 0^'^ is non-trivial on TQ^' if and only ifV{g, r, r'). 
Proof. Note that 

W"' = {(2/,ff"'2/5) : y e Hr,2kngHr',2k'g-'} 

and therefore (|19p holds if and only if 9^'^ is not trivial on T-C^'^ . li r ^ r' this 
proves the lemma. If r = r' it remains to show that when 9^'"^ is trivial on Tlg''^ 
then 9^'^ is not trivial on W''' if and only if we have (pO|) . Note that 



{h e H'V'- . (;,^ _1) £ ^r,.| ^ {(y,g-ly ' g) : y G H^ak H 5i?r',2;o'3"}. 

If y e Hr^2k n gHri.2k'g^ then for /i = {y,g'^y *.g) £ 7^'"''' we have h ■ *g = g 
and therefore by O we get that h^{h) e H^J''' so that 9"'^'' {h ^{h)) ^ 1. Since 
gr,r _ Qr,r q ^ wc havc 9^'^ (h) G {±1}. Thc remaining of the lemma follows. D 

We make here another simple observation that will help to shorten some of the 
arguments in the proof of Proposition [2l 

Lemma 2. IfV{g,r,r') then P{h ■ g,r,r') for all h G Tt and V{'^g,r' ,r). 

Proof. Note that Hh.g ~ hHgh^^ and that 6* is a character. Thus, the first state- 
ment is immediate from Lemma [T] If r = r' this argument with h = {eu, ~1) also 
contains the second statement. If r ^ r' the second statement follows from the fact 
that rCtf = C(Wg '■') (that follows from ) and the fact that 9o(_=e. D 

In light of Lemma [1] in order to show Proposition [5] we need to show that for 
every r, r' < n such that n — r = n — r' = 0( mod 2) and for every g € G we have 
V{g, r, r'). This will occupy the rest of this paper. 

5.2. Two cases where V{g, r, r') is already known. There are two extremes 
that are already known. The first is a well known fact concerned with the double 
coset space C/„\G'/C/„. It can be found in the proof of |GK75[ Lemma 4.3.8] (it is 
essentially the steps (a)-(d) verifying condition 4 of |GK75[ Theorem 4.2.10]) and 
it is applied in order to prove the uniqueness of Whittaker models. 

Lemma 3. For every g G G we have Vn{g,n,n). 

The second extreme is with respect to the symplectic group. It was proved by 
Heumus and Rallis [IIR90[ Proposition 2.3.1] based on results of Klyachko |Kly84[ 
Corollary 5.6]. Recently, Goldstein and Guralnick essentially provided an indepen- 
dent proof over any field [GG07| Proposition 3.1]. 

Lemma 4. When n is even for every g £ G we have Vnig, 0, 0). 
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Proof. We show that when r = r' = ([20| holds for every g ^ G. That is, we 
show that for every 5 e G we have *g £ Sp{Jn)gSp{Jn)- As observed m the proof 
of Lenima[21 it is enough to prove that there exists y £ Sp{Jn)gSp{Jn) such that 
*y £ Sp{Jn)gSp{Jn). Let n — 2k and let 

J„=(^ _/, )= '^J"^wherea=(^ ^ ^^ 
Thus, 

Sp{Jn) = (7^^Sp{Jn)cr- 

It follows from |GG07| Proposition 3.1] that there exists g' £ Gk such that diag(/fe, g') G 
Sp{J^)a~^gaSp{J!^), i.e that y = crdiag(/A:,5')cr~^ G Sp{Jn)gSp{Jn)- Since ev- 
ery matrix in Gk is conjugate to its transpose and since diag(a;,*a;) £ Sp{J^) 
for every x £ Gk we see that diag(/fc,*5') £ Sp{J^)agaSp{J^), i.e. that *y = 
adiag(/fc,*g')'^"' G Sp{Jn)gSp{J„). D 

6. Proof by induction of Vn{g,r,r') 

Fix 2 decompositions n = r + 2k = r' + 2k' . We prove by induction on n that for 
every g £ G we have Vnig, r,r'). li r = r' = then this is Lemma H] We assume 
from now on that r + r' > 0. By the induction hypothesis we may also assume 
that for all ni < n, all ri, r'l < ni such that ni — ri = ni — r'l = 0( mod 2) and 
ah g' £ Gn, we have VnA9'^n,r[). Set H = Hr,2k, H' = Hr' ak' . H = H x h' 
and 6 = O"^'"^ . Let P = Pii^ 2k) ^^'^ P' = P/it'-') 2k')- ^°^ w £ W viewed as a 
permutation in S[l,n] let 

Iw = {i£ [l,r] ■.w-\i)£ [1,/]}. 

6.1. A simple proof for most Bruhat cells. 

Lemma 5. Let w £ mWm' be sueh that I^ is not empty then 'P{g,r,r') holds for 
every g £ PwP' . 

Proof. Note that U xU £ H and therefore that every 7i-orbit in PwP' contains an 
element of MwM'. In light of Lemma [2] we may assume without loss of generality 
that g £ MwM'. 

Assume first that there exists an integer i such that 1 < i < minj?', r'} and 
In, = w~^{Iw) = [!>*]• We can then write w = diag(u'i,'u;2) for some wi £ S[l,i] 
and W2 £ S[i + l,n\. Thus for g £ MwM' there exists 51, (72 £ Gn-i, and a = 
diag(ai, . . . , Ci) £ Gi such that g ~ diag{Ii,gi)wdia,g{a,g2) — diag{wia,g') for 
g' = 9iW2g2 £ Gn-i- Let (ui,u5,e) £ (7i,''')u,ia be such that 6'*'*(ui, u^, e) ^ 1 
and let {hi,hl,e') £ (K-K"\' be such that ^-^^'''-'(/ii, /i^, e') 7^ 1. The first 
exists by Lemma |3l For the second we apply the induction hypothesis to have 
Vn-iig' 1 r — i,r' — i). If e = 1 then 

h^ (diag(ui, /„_,), diag(u2,/„_.0'',l) £ Hg a.nd 9{h) = 6''-*(ui,m^, 1) ^ 1. 
Sinfilarly, if e' = 1 then 

h = (diag(/,, hi), diag(/„ /i2)", 1) £ -Hg and e{h) = e'-'-'-'-'ihi, h^, 1) ^ 1. 
If on the other hand e = e' = — 1 then 

h = (diag(ui, hi), d\a.g{u2,h2)^ , -1) £ Hg and 9{h) = -1. 
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We are now left with the case that either I^ or w^^{Iiu) is not of the form [l,i] 
as above. Note that if g e Pw'P' then 'g G P'w^^T and that w^^ e ApW^. It 
foUows from Lemma [5] that it is enough to prove our lemma either for g or for *g. 
We may therefore assume, without loss of generality, that /^, is not of the form 
[l,i] for any 1 < i < min{r, r'}. Since we assume that g e MwM' there exist 
ffi G G2fe, 52 G G2k' and a — diag(ai, . . . , a,') a diagonal matrix in G,' such that 
g = diag(Jr, (7i)w diag(a, (72)- By our assumption on w we have that [1, r] \ I^ is not 
empty. Let £ = min([l, r] \ Iw)- Since [1,^—1] is contained but does not equal Iw 
the set {£+l,r]r\Iw is not empty. Let q = min([£ + 1, r] n /„,)■ Then q—1 ^ Iw and 
q e Iw In particular, w~^{q — 1) > r' and w~^{q) < r' . Let Ei^j G Mnx7i{F) be 
the matrix with (6, c)*'' entry equal to ^(ij),(6.c) and let Ui,j{s) = /„ + s Eij, s € F. 
Note that Uq-i^q{s) € U C Hr,2k and that '4'r,2k{uq-i^q{s)) = i^{s). Thus, there 
exists s G F such that ■(/'r,2fc(wg-i,q(s)) 7^ 1- On the other hand. 



9 ^Uq-l^q{s)g = { p 1 j U^-l(g_l),„-l(g)(s) f 



52 



/,./ 

* hk' 



eHr' 



,2k' 




and V'r',2/c'(g ^Uq^i^q{s)g) = 1. It follows that ft-s = {Uq^l^q{s),g ^Uq^l^q{s)g) G TYg 
and if s is such that i!r,2k{uq-i.q{s)) ^ 1 then 0(/is) 7^ 1- D 

6.2. The closed Bruhat ceU. We are now left with the case that I^ is empty. 
Since this means that w^^ maps [l,r] into [r' + l,n] we must have, in particular, 
n > r + r'. It is not difficult to see that there is then a unique such element in 
mWm', namely, 





^n—{r-\-r') 

Note then that PwP', is the closed Bruhat cell. We remark further that this 
contains the case that either r or r' is 0. Let g G MwM'. Note that there exist 
gi G G2/C and 52 G G2fc' such that 

f Ir \ f Ir' 

Indeed, for t G Gr, t' G Gr' (and in particular when t and t' are diagonal) if 
g'l G G2fc and ^2 ^ G2k' we have 

t \ / t' 

''^[0 /„_(,.^,., ; V 92 J \ 91 J \ 92 

where gi = gj diag(t',/2fe-r') and 52 = diag(i,/2fc'-r)ff2- 

In order to show V{9,r,r') we distinguish between 2 cases. We denote by 
(wi, . . . , Wi) the subspace of a vector space y spanned by ui, . . . , w; G F. Let F 
be a subspace of the vector space Mgxi{F) for some positive integer £. We say that 
a skew symmetric matrix X G M^x^(-F) is totally isotropic on V if *wXw' = for all 





9'2 J 





t 


t' 








/„_(,.+»•') 
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w, v' e V. Denote by e^ the column vector with 1 in the i*'' row and in each other 
row. Thus et G Miy,i{F) for an integer I which is inipUcit in our notation. Let 

ii = ^giJ2kgi and I2 = glJ2k'g2^- 

We say that g belongs to the totally isotropic case if both I^^ is totally isotropic 
on (ei, . . . , e,') and 22 is totally isotropic on (ei, . . . , e^) . Otherwise we say that g 
does not belong to the totally isotropic case. It is easy to verify that this property 
indeed depends only on g and not on gi and (72- We now prove 'P{g, r, r') separately 
in each of the 2 cases. 

6.2.1. When g does not belong to the totally isotropic case. In this case we prove 
that g satisfies p^ . It will be convenient to make this property more explicit. We 
say that the 2 skew-symmetric forms Xi, X2 G G satisfy the property Q(2i,X2, r, r') 
if there exist u & Ur and u' £ Ur' such that ipriu) ^ ipr'{u') and for some X G 
Mrx2k'-r{F), Y G Mr'x2k-r'{F) and D G Gn-{r+r') we havc 

I l)e Sp{X2) and ( *^' M G Sp{l,). 



Lemma 6. Let 



and let 



g = 



91 J \ 52 



G MwM' 



Ji = *.gi J2fe.gi and J2 = gJJ"2fe'.92 ^• 
Then g satisfies (|19p if and only if Q{Ii,I2,t,t')- 

Proof. Let 

with u G Ur, h G Sp{J2k) and Z G Mrx2k{F). To explicate condition (fT9|) we 
compute g^^yg. First note that we have 

gi' J\ h ){ gi J~\ gi'hg. 



We write 



gi^hgi=[ y ^ ) and Zgi = (^1,^2) 



Withu' G Mr'xr'iF), D G M2k-r'x2k-T'{F), Zi G Mrxr'{F) and ^2 G Mrx2k-r'{F). 

We then have 




-'n— (r+r') 




*7/' 





B 


Zi 


7^ 


Z2 


Y 





D 



Therefore, 



(0, B)g2 

g^^yg =1 „-^ f ^^ \ „-i f u Z2 



32 1 y I 52 I i? '^' 



We see that g ^yg G H' if and only if u' G Ur', B = and 

u Z2 

D 



■92 M n n )-92 ^ Sp{J2k')- 
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Recall also that 

*"' ^ -lo rr ^ 

With this notation, when g^^yg G H' we have 

e{y,g-'yg)^Mu)A'iiuT')- 
Since 

g^^Sp{J2k)gi = Sp{Ii) and g2Sp{J2k)g2^ = Sp{l2), 
the lemma is now immediate. D 

In order to proceed we need the following Lemma of Klyachko |Kly84[ §1.3, p. 
368, Step 3]. 

Lemma 7. Let I ~ — *Z G G2k and let r < 2k be such that I is not totally isotropic 
on (ei, . . . jCr) then there exists u & Ur with ipriu) ^ 1 and X € Mrx2k-r{F) such 
that 

(^>) ( I ,L ) ^ *"«■ 

Proof. Let i G [1, r — 1] be maximal so that T is totally isotropic on (ei, . . . , Ci) . 
There is therefore wo G (ei, . . . , Ci) such that *woIei+i ^ 0. We may further assume 
that Up G Ci + (ei, . . . , ei_i) since if ^eilci+i ^ then we may take uq = Ci 
and otherwise, we may replace vq by its sum with any scalar multiple of e^. Let 
V — M2kxi{F) and for every s & F define As G Homi?(V,i^) by \s{v) ~ s'^vqTv. 
Note that the map s i-^ As(ei+i), s G F is onto F. Identify GL{V) with G2k via the 
standard basis {ei, . . . , e2k} and define an element hg G G2k by 

hs{v) = V + As(w) Wo- 

Thus, hs G Sp{I) is of the form ^ with ■(/'r(u) = -(/'(As(ei+i)). □ 

Lemma 8. Let 

not belong to the totally isotropic case and let 

1i = *giJ2kgi and I2 = glJ2k'g2 ■ 

Then we have Q{Xi,X2,f,r'). 

Proof, li I2 is not totally isotropic on {ei, . . . ,er) then by Lemma [7] there exist 
u £ Ur and X G Mrx2k'-r such that 4'r{u) ^ 1 and 

n r ^ ) e Spi^2). 

U l2k'~r J 

Then Q{Ii,l2,r,r') is satisfies with F = 0, u' = /r' and D = In-{r+r')- Note 
further that S'p(X]^^) = {*g : g G Sp{Xi)}. Thus, if Xf ^ is not totally isotropic 
on (ei, . . . jCr') then by Lemma [7] applied to X^ there exist u' G Ur' and Y G 
M2k-r'xr' such that tpr'iu') ^ 1 and 

y / ) e 5p(Zi). 

J^ J-2k-r' J 

Thus, Q{Xi,X2, r, r') is satisfies with X ~ 0, u ~ Ij. and D ~ In_ij.+r')- ^ 
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6.2.2. When g belongs to the totally isotropic case. Assume from now on that both 
22 is totahy isotropic on (ei, . . . , Cr) and Xj" is totaUy isotropic on (ei, . . . , er') . In 
the case at hand Ti, ■ g contains an element of a rather simple form that will allow 
us the inductive argument. In order to bring g to this simpler form we need the 
following lemma. 

Lemma 9. Let £ < m and Q ~ P{e.2m-e)- Then 

Sp{J2m) Q = {g ^ G2m ■ ^gJ^mQ is totally isotropic on (ei, . . . , et)}. 

Proof. If /i e Sp{J2m) and q & Q then *{hq)J2mhq = *qJ2rnq- Since q preserves 
the space (ei, . . . , ei) and since J2m is totally isotropic on (ei, . . . , ei) we get that 
^qJ2mq is also totally isotropic on (ei,...,e£). To prove the other direction let 
9 G G2m be such that *gJ2mg is totally isotropic on (ei, . . . , e^) . Then 






g*J2m9 = t A T-, ] '^G 



for some D ^ —*^D ^ M2m-ex2m-e{F) ■ We must show that there exists q & Q such 
that *qxq = J2m- Since x is invertible and £ < 2m — £ the matrix A is of rank £. 
Performing elementary operations, there exists a (z Gi and 7 G G2m-t such that 
*aA7 = (0^x2(m-£)i w^«)- It follows that for q = diag(a,7) G Q, *qxq has the form 




where a = — *a G G2(m-i) and d = — *d G A-hy,i{F). Write fi = (/3i,/32) with 
Pi e Mty2{m-t){F) and P2 £ Mt,ji{F). Note that 



h 

*/3i /: 



*/32 



2{m~t) 




We may now take j3i — —we^b. Any skew symmetric matrix in Mixe{F) can be 
written as a difference X — *X for some X G Mixe{F). Thus, there also exists (32 
such that *(32'We — Wi(32 = —d. We get that there exists q £ Q such that 



*qxq =1 a 



u;^ 
a 
Wf 



Let y G G2(m-f) be such that ^yay = J2{m-i)- Thus q' = qdmg{Ii,y,Ii) G Q and 
*(7'xg' = J2m. D 

For X e Gi let 
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The following property of the group Sp{J2m) will be used several times in the proof 
of V{g, r, r'). Assume that £ < m. 

(22) For all x G d, s G Sp{J2{m-e)) and y there exists y* uniquely determined 
by x, s and y and dependent linearly on y and there exists z such that 

z \ / X 

y I (rcsp. \ y* s | ) lies in Sp{J2m)- 
z y X 

We now choose a convenient representative for g. 
Lemma 10. Let 

^'' ^w( ^'■' I G MwM' 




91 J \ 92 

belong to the totally isotropic case. Then there exists 7 G Gn-{r+r') such that 

/,. \ 
Ir' GH-g. 
7 / 

Proof. Since —T^ = gi J2feffi is totally isotropic on (ei, . . . , e^') andX2 = .gj ^2fe.92' 
is totally isotropic on (ei, . . . , e^), it follows from Lemma [9] that 

.91 G Sp{J2k) f ^^ ^^ \ and .92 ^ ^q ^M Sp{J2k') 

for some ai G G^', 71 G G2k-r' , 0L2 G G^, 72 G G2k'-r and /^^^ and /32 of the 
appropriate size. Therefore, 

a2 ^^ 
ai 

P'l 71 72 

/,. 

ai I I /w I I a2 /3^ I GH-g. 

P[ 71 

Note that diag(ai, /2(fe_r'), "i) G Sp{J2k) and diag(a2, /2(fc'-r), 52) e Sp{J2k') and 
therefore that 

ft, = diag(/r,aj;\/2(A;_r')'"r^) ^ -^^ and h' = diag(/r', a^\/2(fe'-r), a^^) € H'. 
Thus, 

/ a2 /?^ \ / /, /32 \ 

ft ai ft' = /,./ \ en-g 

V (3[ 7172 / V /3i 7 / 

for some 7 G Gn-{r+r'): Pi and /32. Now note that 

/,. /327"'/3i -P2l-^ \ / /, /32 \ / /.' 

Ir' /r' /,. 

/„-(.+.') J \ Pi 7 y V -7-^/3i /„_(,+,.) 

/, 
= I /,.' \ en-g. 
7 
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D 
Lemma 11. Let 7 € Gn-(r+r') o.i^'d let 

/ Ir 
9^1 Ir' 

\ 7 
then V{g, r, r'). 
Proof. Recall that r + r' > 0. Let 

di = f ^^^'-^'^ ) and ^2 = f ^^C^'-'-) 



For X ~ a-^ ja2 we have by the mduction hypothesis 'Pn-(r+r'){xj^j^')- Fix y £ 
Hr.2(k'~r) such that either 

(23) cc^^ya; G i?r',2(fe-r') and 0{y,x^^yx) ^ 1 



or 

(24) r = r', a;~^y *a; £ Hr',2{k-r') and 6'(y, cc^^y *x) = 1. 

For every invertible matrix z denote by z* the matrix z if y satisfies (|23p and the 
matrix *z otherwise. Note that if ([M)) holds then ai = (T2 and therefore in either 
case we have 

X* = CTj" V*0-2- 

There exist s' G Sp{J2(k-r')), u' G f7,,' and g' G Afr/x2(fc-r')(-^) such that 

^^y"^' ^ ( J' *(«-') 

and there exist s G Sp{J2(k'-r))i w G C/r and (? G M2(k'-r)xr{F) such that 

—1 —1 * —1 * —1 I ^ Q 

7 cTiycTi 7 = CTaa; 2/x 0-2 = ( ~ 

Note then that 

(25) e{y,x-^yx*)=M'^)i,r'{u')-\ 

By (f22| there exist (g)')* G M2(fe_r')xr' (-?"), £** £ ^Iry2(k'~r){F),z' and z such that 

/ *u' \ I u Q* z 

h=\ [q'Y s' G ^p(^2fc) and /i' = s g \ (z Sp{J2k'). 
\ z' g' *u' J \ M 

Note that 

/ /,. 

9* = /,.' 
V 7* 
Let 

Ci = (£)*,z)(7*)-iandC = (0.x.',Ci) 
then 

and 9{Y, 9^^Yg*) = ipr{u)tpr'{u')^^- The property Vnig, r, r') therefore follows from 
dm and the fact that either ^ holds or ^ holds. D 
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6.3. Conclusion. For g £ G, hy ^ there exists w E mWm' such that g G PwP' . 
If Iw is not empty then V{g,r,r') is proved in Lemma [51 If Iw is empty then we 
separated in i )6.2l the statement V{g,r,r') into 2 cases. If g belongs to the totally 
isotropic case then V^g, r, r') follows from Lemma [2l Lemma [10] and Lemma 1111 
Otherwise V{g,r,r') follows from Lemma [6| and Lemma [H It follows that for every 
g £ G we have V{g,r,r'). Proposition [2| now follows from Lemma [1] Therefore, 
Proposition [T] follows from §4.11 and Theorem [T] follows from §3.11 
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